Performance and Consistency of ChatGPT-4 Versus Otolaryngologists: A Clinical Case Series.

OBJECTIVE: To study the performance of Chatbot Generative Pretrained Transformer-4 (ChatGPT-4) in the management of cases in otolaryngology-head and neck surgery. STUDY DESIGN: Prospective case series. SETTING: Multicenter University Hospitals. METHODS: History, clinical, physical, and additional examinations of adult outpatients consulting in otolaryngology departments of CHU Saint-Pierre and Dour Medical Center were presented to ChatGPT-4, which was interrogated for differential diagnoses, management, and treatment(s). According to specialty, the ChatGPT-4 responses were assessed by 2 distinct, blinded board-certified otolaryngologists with the Artificial Intelligence Performance Instrument. RESULTS: One hundred cases were presented to ChatGPT-4. ChaGPT-4 indicated a mean of 3.34 (95% confidence interval [CI]: 3.09, 3.59) additional examinations per patient versus 2.10 (95% CI: 1.76, 2.34; P = .001) for the practitioners. There was strong consistency (k > 0.600) between otolaryngologists and ChatGPT-4 for the indication of upper aerodigestive tract endoscopy, positron emission tomography and computed tomography, audiometry, tympanometry, and psychophysical evaluations. Primary diagnosis was correctly performed by ChatGPT-4 in 38% to 86% of cases depending on subspecialty. Additional examinations indicated by ChatGPT-4 were pertinent and necessary in 8% to 31% of cases, while the treatment regimen was pertinent in 12% to 44% of cases. The performance of ChatGPT-4 was not influenced by the human-reported level of difficulty of clinical cases. CONCLUSION: ChatGPT-4 may be a promising adjunctive tool in otolaryngology, providing extensive documentation about additional examinations, primary and differential diagnoses, and treatments. The ChatGPT-4 is more effective in providing a primary diagnosis, and less effective in the selection of additional examinations and treatments.

Evaluating the Potential of AI Chatbots in Treatment Decision-making for Acquired Bilateral Vocal Fold Paralysis in Adults.

OBJECTIVES: The development of artificial intelligence-powered language models, such as Chatbot Generative Pre-trained Transformer (ChatGPT) or Large Language Model Meta AI (Llama), is emerging in medicine. Patients and practitioners have full access to chatbots that may provide medical information. The aim of this study was to explore the performance and accuracy of ChatGPT and Llama in treatment decision-making for bilateral vocal fold paralysis (BVFP). METHODS: Data of 20 clinical cases, treated between 2018 and 2023, were retrospectively collected from four tertiary laryngology centers in Europe. The cases were defined as the most common or most challenging scenarios regarding BVFP treatment. The treatment proposals were discussed in their local multidisciplinary teams (MDT). Each case was presented to ChatGPT-4.0 and Llama Chat-2.0, and potential treatment strategies were requested. The Artificial Intelligence Performance Instrument (AIPI) treatment subscore was used to compare both Chatbots' performances to MDT treatment proposal. RESULTS: Most common etiology of BVFP was thyroid surgery. A form of partial arytenoidectomy with or without posterior transverse cordotomy was the MDT proposal for most cases. The accuracy of both Chatbots was very low regarding their treatment proposals, with a maximum AIPI treatment score in 5% of the cases. In most cases even harmful assertions were made, including the suggestion of vocal fold medialisation to treat patients with stridor and dyspnea. ChatGPT-4.0 performed significantly better in suggesting the correct treatment as part of the treatment proposal (50%) compared to Llama Chat-2.0 (15%). CONCLUSION: ChatGPT and Llama are judged as inaccurate in proposing correct treatment for BVFP. ChatGPT significantly outperformed Llama. Treatment decision-making for a complex condition such as BVFP is clearly beyond the Chatbot's knowledge expertise. This study highlights the complexity and heterogeneity of BVFP treatment, and the need for further guidelines dedicated to the management of BVFP.

ChatGPT-4 accuracy for patient education in laryngopharyngeal reflux.

INTRODUCTION: Chatbot Generative Pre-trained Transformer (ChatGPT) is an artificial intelligence-powered language model chatbot able to help otolaryngologists in practice and research. The ability of ChatGPT in generating patient-centered information related to laryngopharyngeal reflux disease (LPRD) was evaluated. METHODS: Twenty-five questions dedicated to definition, clinical presentation, diagnosis, and treatment of LPRD were developed from the Dubai definition and management of LPRD consensus and recent reviews. Questions about the four aforementioned categories were entered into ChatGPT-4. Four board-certified laryngologists evaluated the accuracy of ChatGPT-4 with a 5-point Likert scale. Interrater reliability was evaluated. RESULTS: The mean scores (SD) of ChatGPT-4 answers for definition, clinical presentation, additional examination, and treatments were 4.13 (0.52), 4.50 (0.72), 3.75 (0.61), and 4.18 (0.47), respectively. Experts reported high interrater reliability for sub-scores (ICC = 0.973). The lowest performances of ChatGPT-4 were on answers about the most prevalent LPR signs, the most reliable objective tool for the diagnosis (hypopharyngeal-esophageal multichannel intraluminal impedance-pH monitoring (HEMII-pH)), and the criteria for the diagnosis of LPR using HEMII-pH. CONCLUSION: ChatGPT-4 may provide adequate information on the definition of LPR, differences compared to GERD (gastroesophageal reflux disease), and clinical presentation. Information provided upon extra-laryngeal manifestations and HEMII-pH may need further optimization. Regarding the recent trends identifying increasing patient use of internet sources for self-education, the findings of the present study may help draw attention to ChatGPT-4's accuracy on the topic of LPR.

Validity and Reliability of the Reflux Sign Assessment-10 (RSA-10).

OBJECTIVE: To develop and validate the Reflux Sign Assessment-10 (RSA-10) for documenting the physical findings of laryngopharyngeal reflux disease (LPRD). METHODS: Patients with LPRD at the hypopharyngeal-esophageal multichannel intraluminal impedance-pH monitoring and asymptomatic individuals were consecutively recruited from two European hospitals. Three experienced otolaryngologists rated RSA-10 in patients and controls for assessing internal validity. RSA-10 was rated within a 7-day period to assess test-retest reliability. Internal consistency was measured using Cronbach's α in patients and controls. Convergent validity was evaluated through a correlation analysis between RSA-10 and Reflux Finding Score (RFS). Interrater reliability was evaluated by comparing the RSA-10 evaluations of the three otolaryngologists through Fleiss kappa. Pre- to posttreatment change of RSA-10 was evaluated to assess responsiveness to change. The RSA-10 thresholds were examined by receiver operating characteristic analysis. RESULTS: Fifty-five patients completed the pre- to posttreatment evaluations from January 2020 to December 2023. A total of 115 asymptomatic individuals completed the study. RSA-10 reported high internal consistency reliability (α = 0.822) and test-retest reliability (rs = 0.725). The RSA-10 scores of patients were significantly higher than those of controls (p = 0.001), suggesting high internal validity. RSA-10 was significantly correlated with the RFS (rs = 0.771). The interrater reliability was adequate for sub- and total RSA-10 scores (k = 0.708). RSA-10 significantly improved from baseline to 3-month posttreatment (p = 0.001). An RSA-10 > 13 may be suggestive of LPRD. Both RSA-10 > 13 and Reflux Symptom Score-12 > 11 were associated with a sensitivity of 92.7% and a specificity of 97.3%. CONCLUSION: The RSA-10 is a reliable and valid clinical instrument for documenting the most prevalent laryngeal and extra-laryngeal findings associated with LPRD. LEVEL OF EVIDENCE: 3 Laryngoscope, 2024.

Taste and Smell Disorders: A Critical Look at Olfactory and Gustatory Dysfunction.

In an era where modern medicine has made remarkable advances in managing diseases in the head and neck region, we present this Special Issue to provide a spotlight on the new research advances on olfactory and gustatory disorders [...].

The Impact of the Post-Traumatic Facial Reconstruction on Postoperative Weight Loss.

Objectives: To identify risk factors and evaluate the impact of various facial fractures and reconstruction surgeries on postoperative weight change. Methods: Retrospective, monocentric study was performed at a tertiary care center. Medical history, type and mechanism of fracture, operative factors, and postoperative weights at follow-up appointments for 145 adult patients undergoing surgical repair for maxillofacial fractures were collected. Further information was obtained on postoperative diet and whether patients received maxillomandibular fixation (MMF). Univariate and multivariate analyses were utilized to evaluate effects of surgical reconstruction after facial trauma on postoperative weight loss. Results: Patients lost 3.2 ± 4.9 kg (95% confidence interval = 2.7-4.1, P < .0001) on average, with maximum loss between date of surgery and first follow-up. Univariate analysis demonstrated that intensive care unit admission (5.9 kg, SD 5.4, P = .001), nasogastric tube placement (5.1 kg, SD 4.6, P = .012), and MMF (4.4 kg, SD 5.4, P < .0001) were associated with more severe weight loss. Multivariate analyses showed that only MMF remained a significant risk factor for increased weight loss (avg. 6.0, standard error 1.93, t value 3.11, P = .0024). Conclusions: We report significant weight loss following facial trauma and reconstruction, which emphasizes the need to perform further studies on nutrition protocols for this patient population to optimize wound healing.

Is there a role for voice therapy in the treatment of laryngopharyngeal reflux? A pilot study.

Objective: The aim of this study was to compare the efficacy of voice therapy combined with standard anti-reflux therapy in reducing symptoms and signs of laryngopharyngeal reflux (LPR). Methods: A randomised clinical trial was conducted. Fifty-two patients with LPR diagnosed by 24 h multichannel intraluminal impedance-pH monitoring were randomly allocated in two groups: medical treatment (MT) and medical plus voice therapy (VT). Clinical symptoms and laryngeal signs were assessed at baseline and after 3 months of treatment with the Reflux Symptom Index (RSI), Reflux Finding Score (RFS), Voice Handicap Index (VHI) and GRBAS scales. Results: Groups had similar scores at baseline. At 3-month follow-up, a significant decrease in RSI and RFS total scores were found in both groups although it appeared to be more robust in the VT group. G and R scores of the GRBAS scale significantly improved after treatment in both groups, with better results in the VT group. The VHI total score at 3 months improved more in the VT group (VHI delta 9.54) than in the MT group (VHI delta 5.38) (p < 0.001). Conclusions: The addition of voice therapy to medications and diet appears to be more effective in improving treatment outcomes in subjects with LPR. Voice therapy warrants consideration in addition to medication and diet when treating patients with LPR.

Validity and reliability of the Questionnaire of Olfactory Disorders for Italian-speaking patients with olfactory dysfunction.

Objective: To translate and validate an Italian version of the Questionnaire of Olfactory Disorders (IT-QOD). Materials and methods: This is a prospective, multicentre study that involved patients with olfactory dysfunction (OD). Both cases and controls underwent administration of the IT-QOD, Sino-Nasal Outcome Test-22 (SNOT-22) and psychophysical evaluation of orthonasal and retronasal olfactory function. Results: The IT-QOD was administered to 96 patients and 38 controls. The Cronbach's alpha exceeded 0.90, indicating satisfactory internal consistency. The test-retest reliability was found to be high for both parosmia (rs = 0.944) and life quality (rs = 0.969). Patients with OD had significantly higher IT-QOD scores compared to healthy individuals (p < 0.001), indicating strong internal validity. The external validity was also satisfactory, as shown by the significant correlation with SNOT-22 (rs = -0.54) and the threshold, discrimination, and identification score (rs = -0.63). Conclusions: The IT-QOD was demonstrated to be reliable and valid to assess the impact of OD on the quality of life of Italian-speaking patients.

Digestive Biomarkers of Laryngopharyngeal Reflux: A Preliminary Prospective Controlled Study.

OBJECTIVE: To investigate the digestive enzymes and biomarkers in the saliva of patients with laryngopharyngeal reflux (LPR) and asymptomatic individuals. STUDY DESIGN: Prospective controlled study. SETTING: Multicenter study. METHODS: Patients with LPR at the hypopharyngeal-esophageal impedance-pH monitoring (HEMII-pH) and asymptomatic individuals were consecutively recruited from January 2020 to April 2023 from 2 University Hospitals. The saliva of patients (off PPIs) and asymptomatic individuals was collected to measure pH, elastase, bile salts, cholesterol, gastric, and pancreatic lipases. Anxiety, symptoms, and findings were studied through perceived stress scale (PSS), reflux symptom score (RSS), and reflux sign assessment (RSA). RESULTS: Sixty-seven LPR patients and 57 asymptomatic individuals completed the evaluations. LPR patients reported higher PSS, RSS, and RSA than asymptomatic individuals. The mean saliva pH was more alkaline in LPR patients (7.23: 95% confidence interval [CI]: 7.08, 7.38) compared to controls (6.13; 95% CI: 5.95, 6.31; P = .001). The mean concentration of elastase was higher in patients (51.65 µg/mL; 95% CI: 44.47, 58.83 µg/mL) versus asymptomatic individuals (25.18 µg/mL; 95% CI: 21.64, 28.72 µg/mL; P = .001). The saliva cholesterol reported higher concentration in healthy individuals (3.43 mg/dL; 95% CI: 3.21, 3.65 mg/dL) compared to patients (1.16 mg/dL; 95% CI: 1.05, 1.27 mg/dL; P = .001). The saliva pH, and elastase concentration were significantly associated with the baseline RSS, while saliva cholesterol was negatively associated with the severity of RSS and RSA. CONCLUSION: Cholesterol, bile salts, and elastase are biomarkers of LPR and should be considered to develop future non-invasive saliva device for the detection of LPR.

Diagnostic Value of Fasting and Bedtime Saliva Pepsin Measurements in Laryngopharyngeal Reflux.

BACKGROUND: The pepsin test is an emerging non-invasive diagnostic approach for laryngopharyngeal reflux (LPR). The aim of this study was to investigate the diagnostic value of multiple salivary pepsin tests for detecting LPR. METHODS: Patients with suspected LPR and asymptomatic individuals were consecutively recruited from January 2020 to November 2022. Patients benefited from hypopharyngeal-esophageal impedance-pH monitoring (HEMII-pH) and fasting and bedtime saliva collections to measure oral pepsin. The sensitivity, specificity, and positive (PPV) and negative (NPV) predictive values were calculated considering fasting, bedtime, and the highest values of the pepsin tests at ≥16, ≥36, ≥45, and ≥100 ng/mL cutoffs. RESULTS: The pepsin test was adequately performed in 147 LPR patients and 32 controls. The pepsin tests were 81.6%, 74.8%, and 61.5% sensitive at cutoffs of ≥16, ≥45, and ≥100 ng/mL, respectively. The PPVs were 93.0%, 94.0%, and 94.8%, respectively. The highest specificity (81.8%) was found for the fasting pepsin test at a cutoff of 100 ng/mL. The highest sensitivity (81.6%) was found by considering the highest measured pepsin test at the ≥16 ng/mL threshold. The measurement of fasting saliva pepsin was associated with the highest sensitivity and specificity value. At ≥16 ng/mL, 27 patients had negative findings, indicating that 18.4% (27/147) of the true positive cases were missed by considering the highest pepsin test. The receiver operating characteristic curve reported that a cutoff of 21.5 was 76.9% sensitive and 62.5% specific, while the PPV and NPV were 91.1% and 38.2%, respectively. CONCLUSIONS: The consideration of the highest concentration of the fasting and bedtime saliva pepsin collections at a cutoff of 21.5 was associated with the best detection rate and sensitivity of the pepsin tests.

Reply to Ronsivalle, S.; Di Luca, M. Exploring the Choice of Graft Materials in Tympanoplasty: A Perspective on the Use of Temporalis Fascia and Cartilage Grafts. Comment on "Ferlito et al. Type 1 Tympanoplasty Outcomes between Cartilage and Temporal Fascia Grafts: A Long-Term Retrospective. J. Clin. Med. 2022, 11, 7000".

We sincerely appreciate the valuable insights Ronsivalle et al [...].

Clinical Application of Pediatric Sleep Endoscopy: An International Survey.

OBJECTIVES: To investigate through an international survey the actual clinical application of drug-induced sleep endoscopy (DISE) in pediatric patients with obstructive sleep apnea (OSA) and to clarify the use, application, clinical indications, and protocol of pediatric DISE. METHODS: A specific survey about pediatric DISE was initially developed by five international otolaryngologists with expertise in pediatric sleep apnea and drug-induced sleep endoscopy and was later spread to experts in the field of sleep apnea, members of different OSA-related associations. RESULTS: A total of 101 participants who answered all the survey questions were considered in the study. Sixty-four sleep apnea experts, equivalent to 63.4% of interviewed experts, declared they would perform DISE in pediatric OSA patients. A total of 81.9% of responders agreed to consider the DISE as the first diagnostic step in children with persistent OSA after adenotonsillectomy surgery, whereas 55.4% disagreed with performing DISE at the same time of scheduled adenotonsillectomy surgery to identify other possible sites of collapse. In the case of young patients with residual OSA and only pharyngeal collapse during DISE, 51.8% of experts agreed with performing a velopharyngeal surgery. In this case, 27.7% disagreed and 21.4% were neutral. CONCLUSION: Pediatric DISE is internationally considered to be a safe and effective procedure for identifying sites of obstruction and collapse after adenotonsillectomy in children with residual OSA. This is also useful in cases of patients with craniofacial malformations, small tonsils, laryngomalacia or Down syndrome to identify the actual site(s) of collapse. Despite this evidence, our survey highlighted that pediatric DISE is not used in different sleep centers.

Office-based blue laser therapy for vocal fold polyps and Reinke's edema: a case study and review of the literature.

PURPOSE: To report the efficacy of blue laser in the treatment of vocal fold polyps and Reinke's edema in an office setting. METHODS: The medical records and video-recordings of patients who underwent office-based blue laser therapy in a tertiary referral center for vocal fold polyps and/or Reinke's edema were reviewed. The primary outcome measures were the Voice Handicap Index-10 (VHI-10) score and disease regression. Acoustic and aerodynamic parameters were also analyzed. RESULTS: Thirty-five patients (21 with vocal fold polyps and 14 with Reinke's edema) were included and a total of 47 lesions were treated. Out of the 35 patients, 7 patients were lost for follow-up. The mean VHI-10 score dropped significantly after surgery by 17.41 ± 8.67 points (p < 0.001). The endoscopic examinations of 38 lesions were reviewed (17 vocal fold polyps and 21 Reinke's edema) before and up to 6 months after laser therapy. In the subgroup with vocal fold polyps (N = 17), there was complete disease regression in 13 and partial in 4. In the subgroup with Reinke's edema (N = 21), there was complete disease regression in 7 and partial disease regression in 14. For patients with vocal fold polyp, there was a significant decrease in shimmer and a significant increase in maximum phonation time postoperatively. For patients with Reinke's edema, there was a significant decrease in shimmer and noise-to-harmonic ratio following treatment. CONCLUSION: Office-based blue laser therapy is an effective treatment for vocal fold polyps and Reinke's edema leading to complete or partial disease regression. All patients had improvement in voice quality.

Accuracy of ChatGPT-3.5 and -4 in providing scientific references in otolaryngology-head and neck surgery.

INTRODUCTION: Chatbot generative pre-trained transformer (ChatGPT) is a new artificial intelligence-powered language model of chatbot able to help otolaryngologists in practice and research. We investigated the accuracy of ChatGPT-3.5 and -4 in the referencing of manuscripts published in otolaryngology. METHODS: ChatGPT-3.5 and ChatGPT-4 were interrogated for providing references of the top-30 most cited papers in otolaryngology in the past 40 years including clinical guidelines and key studies that changed the practice. The responses were regenerated three times to assess the accuracy and stability of ChatGPT. ChatGPT-3.5 and ChatGPT-4 were compared for accuracy of reference and potential mistakes. RESULTS: The accuracy of ChatGPT-3.5 and ChatGPT-4.0 ranged from 47% to 60%, and 73% to 87%, respectively (p < 0.005). ChatGPT-3.5 provided 19 inaccurate references and invented 2 references throughout the regenerated questions. ChatGPT-4.0 provided 13 inaccurate references, while it proposed only one invented reference. The stability of responses throughout regenerated answers was mild (k = 0.238) and moderate (k = 0.408) for ChatGPT-3.5 and 4.0, respectively. CONCLUSIONS: ChatGPT-4.0 reported higher accuracy than the free-access version (3.5). False references were detected in both 3.5 and 4.0 versions. Practitioners need to be careful regarding the use of ChatGPT in the reach of some key reference when writing a report.